Skip to content

Add details about running GitHub actions tests locally #9363

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Merged
merged 4 commits into from
Aug 19, 2025
Merged

Add details about running GitHub actions tests locally #9363

merged 4 commits into from
Aug 19, 2025

Conversation

cecile75
Copy link
Collaborator

What Does This Do

In the README file of the github actions:

  • clarify what is needed to run the tests locally.
  • add an example so it's clearer that running the tests locally can have consequences on the repository

Motivation

Be sure nobody runs the tests locally thinking they are just tests and won't affect the current repository

Additional Notes

PerfectSlayer
PerfectSlayer reviewed Aug 14, 2025
View reviewed changes
.github/workflows/README.md Outdated
> Locally running workflows will still query GitHub backend and will update the GitHub project accordingly.
> Pay extra attention to the workflow jobs you trigger to not create development disruption.
> Locally running workflows will still query GitHub backend and will update the GitHub project accordingly.
> For example, running 'tests/add-milestone-to-pull-requests/test-pull-request.sh' locally will add a milestone, on this github repository, to the PR whose ID is written in 'tests/add-milestone-to-pull-requests/payload-pull-request.json' as 'pull_request.number', if it hasn't one already.
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💭 thought: ‏I would not give a specific test scenario as example as it will increase the extra work maintaining it.
But having an explicit notice about "tests will run against the repository and will potentially alter existing issues, milestones and releases."

Copy link
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I wanted to write a concrete example as it's more meaningful to me but I agree that it's not great for maintenance.
Talking about "existing issues, milestones and releases" is already an improvement, let's go with that.

cecile75 and others added 2 commits August 14, 2025 14:17
@cecile75 @PerfectSlayer
Update .github/workflows/README.md
5815f4c 
Co-authored-by: Bruce Bujon <PerfectSlayer@users.noreply.github.com>
@cecile75
Remove concrete example
30becd8
@pr-commenter
Copy link

pr-commenter bot commented Aug 14, 2025 •
edited
Loading

Benchmarks

Startup

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master cecile/githubactions
git_commit_date 1755501344 1755506183
git_commit_sha 9f546b9 2819125
release_version 1.53.0-SNAPSHOT~9f546b948b 1.53.0-SNAPSHOT~2819125973
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1755508040 1755508040
ci_job_id 1083808475 1083808475
ci_pipeline_id 73925016 73925016
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-hmz7rsyf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-hmz7rsyf 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux
module Agent Agent
parent None None

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 44 metrics, 15 unstable metrics.

Startup time reports for insecure-bank 
gantt
    title insecure-bank - global startup overhead: candidate=1.53.0-SNAPSHOT~2819125973, baseline=1.53.0-SNAPSHOT~9f546b948b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.053 s) : 0, 1052552
Total [baseline] (8.585 s) : 0, 8584569
Agent [candidate] (1.044 s) : 0, 1043625
Total [candidate] (8.581 s) : 0, 8580797
section iast
Agent [baseline] (1.171 s) : 0, 1170995
Total [baseline] (9.301 s) : 0, 9300969
Agent [candidate] (1.176 s) : 0, 1175533
Total [candidate] (9.317 s) : 0, 9316798
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.053 s -
Agent iast 1.171 s 118.442 ms (11.3%)
Total tracing 8.585 s -
Total iast 9.301 s 716.399 ms (8.3%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.044 s -
Agent iast 1.176 s 131.908 ms (12.6%)
Total tracing 8.581 s -
Total iast 9.317 s 736.001 ms (8.6%) 
gantt
    title insecure-bank - break down per module: candidate=1.53.0-SNAPSHOT~2819125973, baseline=1.53.0-SNAPSHOT~9f546b948b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.441 ms) : 0, 1441
crashtracking [candidate] (1.426 ms) : 0, 1426
BytebuddyAgent [baseline] (736.823 ms) : 0, 736823
BytebuddyAgent [candidate] (730.856 ms) : 0, 730856
GlobalTracer [baseline] (243.14 ms) : 0, 243140
GlobalTracer [candidate] (241.193 ms) : 0, 241193
AppSec [baseline] (30.382 ms) : 0, 30382
AppSec [candidate] (29.967 ms) : 0, 29967
Debugger [baseline] (6.07 ms) : 0, 6070
Debugger [candidate] (6.023 ms) : 0, 6023
Remote Config [baseline] (663.905 µs) : 0, 664
Remote Config [candidate] (647.473 µs) : 0, 647
Telemetry [baseline] (13.057 ms) : 0, 13057
Telemetry [candidate] (12.65 ms) : 0, 12650
section iast
crashtracking [baseline] (1.414 ms) : 0, 1414
crashtracking [candidate] (1.419 ms) : 0, 1419
BytebuddyAgent [baseline] (845.297 ms) : 0, 845297
BytebuddyAgent [candidate] (848.665 ms) : 0, 848665
GlobalTracer [baseline] (231.613 ms) : 0, 231613
GlobalTracer [candidate] (232.388 ms) : 0, 232388
IAST [baseline] (29.147 ms) : 0, 29147
IAST [candidate] (26.859 ms) : 0, 26859
AppSec [baseline] (28.195 ms) : 0, 28195
AppSec [candidate] (29.812 ms) : 0, 29812
Debugger [baseline] (5.7 ms) : 0, 5700
Debugger [candidate] (6.569 ms) : 0, 6569
Remote Config [baseline] (575.267 µs) : 0, 575
Remote Config [candidate] (579.471 µs) : 0, 579
Telemetry [baseline] (8.233 ms) : 0, 8233
Telemetry [candidate] (8.307 ms) : 0, 8307
Loading
Startup time reports for petclinic 
gantt
    title petclinic - global startup overhead: candidate=1.53.0-SNAPSHOT~2819125973, baseline=1.53.0-SNAPSHOT~9f546b948b

    dateFormat X
    axisFormat %s
section tracing
Agent [baseline] (1.044 s) : 0, 1043649
Total [baseline] (10.725 s) : 0, 10725077
Agent [candidate] (1.043 s) : 0, 1042523
Total [candidate] (10.747 s) : 0, 10747296
section appsec
Agent [baseline] (1.219 s) : 0, 1219114
Total [baseline] (10.74 s) : 0, 10739979
Agent [candidate] (1.227 s) : 0, 1227119
Total [candidate] (10.768 s) : 0, 10767839
section iast
Agent [baseline] (1.174 s) : 0, 1174270
Total [baseline] (10.854 s) : 0, 10854401
Agent [candidate] (1.177 s) : 0, 1176529
Total [candidate] (10.898 s) : 0, 10898331
section profiling
Agent [baseline] (1.201 s) : 0, 1200745
Total [baseline] (10.964 s) : 0, 10964223
Agent [candidate] (1.205 s) : 0, 1204683
Total [candidate] (10.937 s) : 0, 10937235
Loading
  • baseline results
Module Variant Duration Δ tracing
Agent tracing 1.044 s -
Agent appsec 1.219 s 175.465 ms (16.8%)
Agent iast 1.174 s 130.621 ms (12.5%)
Agent profiling 1.201 s 157.096 ms (15.1%)
Total tracing 10.725 s -
Total appsec 10.74 s 14.902 ms (0.1%)
Total iast 10.854 s 129.324 ms (1.2%)
Total profiling 10.964 s 239.146 ms (2.2%)
  • candidate results
Module Variant Duration Δ tracing
Agent tracing 1.043 s -
Agent appsec 1.227 s 184.596 ms (17.7%)
Agent iast 1.177 s 134.006 ms (12.9%)
Agent profiling 1.205 s 162.159 ms (15.6%)
Total tracing 10.747 s -
Total appsec 10.768 s 20.543 ms (0.2%)
Total iast 10.898 s 151.036 ms (1.4%)
Total profiling 10.937 s 189.94 ms (1.8%) 
gantt
    title petclinic - break down per module: candidate=1.53.0-SNAPSHOT~2819125973, baseline=1.53.0-SNAPSHOT~9f546b948b

    dateFormat X
    axisFormat %s
section tracing
crashtracking [baseline] (1.428 ms) : 0, 1428
crashtracking [candidate] (1.417 ms) : 0, 1417
BytebuddyAgent [baseline] (730.14 ms) : 0, 730140
BytebuddyAgent [candidate] (729.515 ms) : 0, 729515
GlobalTracer [baseline] (240.915 ms) : 0, 240915
GlobalTracer [candidate] (241.234 ms) : 0, 241234
AppSec [baseline] (30.184 ms) : 0, 30184
AppSec [candidate] (30.072 ms) : 0, 30072
Debugger [baseline] (6.007 ms) : 0, 6007
Debugger [candidate] (5.99 ms) : 0, 5990
Remote Config [baseline] (647.99 µs) : 0, 648
Remote Config [candidate] (646.375 µs) : 0, 646
Telemetry [baseline] (13.363 ms) : 0, 13363
Telemetry [candidate] (12.725 ms) : 0, 12725
section appsec
crashtracking [baseline] (1.421 ms) : 0, 1421
crashtracking [candidate] (1.433 ms) : 0, 1433
BytebuddyAgent [baseline] (753.734 ms) : 0, 753734
BytebuddyAgent [candidate] (758.809 ms) : 0, 758809
GlobalTracer [baseline] (234.105 ms) : 0, 234105
GlobalTracer [candidate] (235.88 ms) : 0, 235880
AppSec [baseline] (169.36 ms) : 0, 169360
AppSec [candidate] (170.013 ms) : 0, 170013
Debugger [baseline] (6.388 ms) : 0, 6388
Debugger [candidate] (7.134 ms) : 0, 7134
Remote Config [baseline] (623.738 µs) : 0, 624
Remote Config [candidate] (610.736 µs) : 0, 611
Telemetry [baseline] (9.151 ms) : 0, 9151
Telemetry [candidate] (8.402 ms) : 0, 8402
IAST [baseline] (23.308 ms) : 0, 23308
IAST [candidate] (23.726 ms) : 0, 23726
section iast
crashtracking [baseline] (1.422 ms) : 0, 1422
crashtracking [candidate] (1.418 ms) : 0, 1418
BytebuddyAgent [baseline] (848.033 ms) : 0, 848033
BytebuddyAgent [candidate] (849.21 ms) : 0, 849210
GlobalTracer [baseline] (231.913 ms) : 0, 231913
GlobalTracer [candidate] (232.74 ms) : 0, 232740
AppSec [baseline] (25.784 ms) : 0, 25784
AppSec [candidate] (29.235 ms) : 0, 29235
Debugger [baseline] (6.479 ms) : 0, 6479
Debugger [candidate] (8.296 ms) : 0, 8296
Remote Config [baseline] (637.863 µs) : 0, 638
Remote Config [candidate] (574.982 µs) : 0, 575
Telemetry [baseline] (8.259 ms) : 0, 8259
Telemetry [candidate] (8.181 ms) : 0, 8181
IAST [baseline] (30.79 ms) : 0, 30790
IAST [candidate] (25.807 ms) : 0, 25807
section profiling
ProfilingAgent [baseline] (109.557 ms) : 0, 109557
ProfilingAgent [candidate] (108.439 ms) : 0, 108439
crashtracking [baseline] (1.4 ms) : 0, 1400
crashtracking [candidate] (1.467 ms) : 0, 1467
BytebuddyAgent [baseline] (765.617 ms) : 0, 765617
BytebuddyAgent [candidate] (768.937 ms) : 0, 768937
GlobalTracer [baseline] (222.555 ms) : 0, 222555
GlobalTracer [candidate] (222.591 ms) : 0, 222591
AppSec [baseline] (30.305 ms) : 0, 30305
AppSec [candidate] (30.192 ms) : 0, 30192
Debugger [baseline] (6.25 ms) : 0, 6250
Debugger [candidate] (6.265 ms) : 0, 6265
Remote Config [baseline] (693.548 µs) : 0, 694
Remote Config [candidate] (699.993 µs) : 0, 700
Telemetry [baseline] (14.683 ms) : 0, 14683
Telemetry [candidate] (16.08 ms) : 0, 16080
Profiling [baseline] (110.19 ms) : 0, 110190
Profiling [candidate] (109.098 ms) : 0, 109098
Loading

Load

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master cecile/githubactions
git_commit_date 1755501344 1755506183
git_commit_sha 9f546b9 2819125
release_version 1.53.0-SNAPSHOT~9f546b948b 1.53.0-SNAPSHOT~2819125973
See matching parameters
Baseline Candidate
application insecure-bank insecure-bank
ci_job_date 1755507713 1755507713
ci_job_id 1083808477 1083808477
ci_pipeline_id 73925016 73925016
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-0-evnf4788 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-0-evnf4788 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 4 performance improvements and 2 performance regressions! Performance is the same for 6 metrics, 12 unstable metrics.

scenario Δ mean http_req_duration Δ mean throughput candidate mean http_req_duration candidate mean throughput baseline mean http_req_duration baseline mean throughput
scenario:load:insecure-bank:tracing:high_load better
[-405.782µs; -182.756µs] or [-5.412%; -2.437%]		 unstable
[-62.943op/s; +112.630op/s] or [-10.196%; +18.244%]		 7.204ms 642.188op/s 7.498ms 617.344op/s
scenario:load:insecure-bank:profiling:high_load better
[-1088.364µs; -784.894µs] or [-11.985%; -8.643%]		 unstable
[-6.991op/s; +154.025op/s] or [-1.411%; +31.082%]		 8.144ms 569.062op/s 9.081ms 495.545op/s
scenario:load:petclinic:tracing:high_load better
[-2.658ms; -1.875ms] or [-5.997%; -4.231%]		 unstable
[-2.052op/s; +13.527op/s] or [-1.944%; +12.817%]		 42.049ms 111.275op/s 44.315ms 105.537op/s
scenario:load:petclinic:no_agent:high_load better
[-1.545ms; -0.892ms] or [-4.107%; -2.372%]		 unstable
[-4.853op/s; +13.153op/s] or [-3.905%; +10.583%]		 36.398ms 128.438op/s 37.616ms 124.287op/s
scenario:load:petclinic:profiling:high_load worse
[+1.708ms; +2.722ms] or [+3.575%; +5.698%]		 unstable
[-11.186op/s; +2.536op/s] or [-11.424%; +2.590%]		 49.994ms 93.588op/s 47.779ms 97.912op/s
scenario:load:petclinic:code_origins:high_load worse
[+1.614ms; +2.463ms] or [+3.636%; +5.549%]		 unstable
[-11.814op/s; +2.464op/s] or [-11.207%; +2.337%]		 46.432ms 100.737op/s 44.393ms 105.412op/s
Request duration reports for petclinic 
gantt
    title petclinic - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~2819125973, baseline=1.53.0-SNAPSHOT~9f546b948b
    dateFormat X
    axisFormat %s
section baseline
no_agent (37.616 ms) : 37314, 37919
.   : milestone, 37616,
appsec (46.815 ms) : 46412, 47219
.   : milestone, 46815,
code_origins (44.393 ms) : 44001, 44785
.   : milestone, 44393,
iast (43.302 ms) : 42931, 43674
.   : milestone, 43302,
profiling (47.779 ms) : 47315, 48242
.   : milestone, 47779,
tracing (44.315 ms) : 43941, 44689
.   : milestone, 44315,
section candidate
no_agent (36.398 ms) : 36093, 36702
.   : milestone, 36398,
appsec (45.999 ms) : 45594, 46403
.   : milestone, 45999,
code_origins (46.432 ms) : 46035, 46829
.   : milestone, 46432,
iast (44.302 ms) : 43914, 44690
.   : milestone, 44302,
profiling (49.994 ms) : 49515, 50473
.   : milestone, 49994,
tracing (42.049 ms) : 41695, 42402
.   : milestone, 42049,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 37.616 ms [37.314 ms, 37.919 ms] -
appsec 46.815 ms [46.412 ms, 47.219 ms] 9.199 ms (24.5%)
code_origins 44.393 ms [44.001 ms, 44.785 ms] 6.777 ms (18.0%)
iast 43.302 ms [42.931 ms, 43.674 ms] 5.686 ms (15.1%)
profiling 47.779 ms [47.315 ms, 48.242 ms] 10.162 ms (27.0%)
tracing 44.315 ms [43.941 ms, 44.689 ms] 6.698 ms (17.8%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 36.398 ms [36.093 ms, 36.702 ms] -
appsec 45.999 ms [45.594 ms, 46.403 ms] 9.601 ms (26.4%)
code_origins 46.432 ms [46.035 ms, 46.829 ms] 10.034 ms (27.6%)
iast 44.302 ms [43.914 ms, 44.69 ms] 7.904 ms (21.7%)
profiling 49.994 ms [49.515 ms, 50.473 ms] 13.596 ms (37.4%)
tracing 42.049 ms [41.695 ms, 42.402 ms] 5.651 ms (15.5%)
Request duration reports for insecure-bank 
gantt
    title insecure-bank - request duration [CI 0.99] : candidate=1.53.0-SNAPSHOT~2819125973, baseline=1.53.0-SNAPSHOT~9f546b948b
    dateFormat X
    axisFormat %s
section baseline
no_agent (4.272 ms) : 4225, 4319
.   : milestone, 4272,
iast (9.134 ms) : 8986, 9282
.   : milestone, 9134,
iast_FULL (14.037 ms) : 13759, 14315
.   : milestone, 14037,
iast_GLOBAL (10.283 ms) : 10105, 10460
.   : milestone, 10283,
profiling (9.081 ms) : 8934, 9227
.   : milestone, 9081,
tracing (7.498 ms) : 7390, 7606
.   : milestone, 7498,
section candidate
no_agent (4.264 ms) : 4214, 4313
.   : milestone, 4264,
iast (9.341 ms) : 9189, 9494
.   : milestone, 9341,
iast_FULL (14.203 ms) : 13921, 14484
.   : milestone, 14203,
iast_GLOBAL (10.215 ms) : 10038, 10391
.   : milestone, 10215,
profiling (8.144 ms) : 8009, 8279
.   : milestone, 8144,
tracing (7.204 ms) : 7105, 7303
.   : milestone, 7204,
Loading
  • baseline results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.272 ms [4.225 ms, 4.319 ms] -
iast 9.134 ms [8.986 ms, 9.282 ms] 4.862 ms (113.8%)
iast_FULL 14.037 ms [13.759 ms, 14.315 ms] 9.765 ms (228.6%)
iast_GLOBAL 10.283 ms [10.105 ms, 10.46 ms] 6.011 ms (140.7%)
profiling 9.081 ms [8.934 ms, 9.227 ms] 4.809 ms (112.6%)
tracing 7.498 ms [7.39 ms, 7.606 ms] 3.226 ms (75.5%)
  • candidate results
Variant Request duration [CI 0.99] Δ no_agent
no_agent 4.264 ms [4.214 ms, 4.313 ms] -
iast 9.341 ms [9.189 ms, 9.494 ms] 5.078 ms (119.1%)
iast_FULL 14.203 ms [13.921 ms, 14.484 ms] 9.939 ms (233.1%)
iast_GLOBAL 10.215 ms [10.038 ms, 10.391 ms] 5.951 ms (139.6%)
profiling 8.144 ms [8.009 ms, 8.279 ms] 3.881 ms (91.0%)
tracing 7.204 ms [7.105 ms, 7.303 ms] 2.94 ms (69.0%)

Dacapo

Parameters

Baseline Candidate
baseline_or_candidate baseline candidate
git_branch master cecile/githubactions
git_commit_date 1755501344 1755506183
git_commit_sha 9f546b9 2819125
release_version 1.53.0-SNAPSHOT~9f546b948b 1.53.0-SNAPSHOT~2819125973
See matching parameters
Baseline Candidate
application biojava biojava
ci_job_date 1755508251 1755508251
ci_job_id 1083808479 1083808479
ci_pipeline_id 73925016 73925016
cpu_model Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz Intel(R) Xeon(R) Platinum 8259CL CPU @ 2.50GHz
kernel_version Linux runner-zfyrx7zua-project-304-concurrent-1-vyjib4yl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux Linux runner-zfyrx7zua-project-304-concurrent-1-vyjib4yl 6.8.0-1031-aws #33~22.04.1-Ubuntu SMP Thu Jun 26 14:22:30 UTC 2025 x86_64 x86_64 x86_64 GNU/Linux

Summary

Found 0 performance improvements and 0 performance regressions! Performance is the same for 11 metrics, 1 unstable metrics.

Execution time for tomcat 
gantt
    title tomcat - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~2819125973, baseline=1.53.0-SNAPSHOT~9f546b948b
    dateFormat X
    axisFormat %s
section baseline
no_agent (1.487 ms) : 1475, 1498
.   : milestone, 1487,
appsec (3.682 ms) : 3464, 3900
.   : milestone, 3682,
iast (2.209 ms) : 2146, 2272
.   : milestone, 2209,
iast_GLOBAL (2.257 ms) : 2194, 2321
.   : milestone, 2257,
profiling (2.072 ms) : 2020, 2124
.   : milestone, 2072,
tracing (2.04 ms) : 1990, 2089
.   : milestone, 2040,
section candidate
no_agent (1.482 ms) : 1471, 1494
.   : milestone, 1482,
appsec (3.629 ms) : 3415, 3843
.   : milestone, 3629,
iast (2.214 ms) : 2152, 2277
.   : milestone, 2214,
iast_GLOBAL (2.261 ms) : 2198, 2325
.   : milestone, 2261,
profiling (2.048 ms) : 1998, 2099
.   : milestone, 2048,
tracing (2.026 ms) : 1977, 2074
.   : milestone, 2026,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.487 ms [1.475 ms, 1.498 ms] -
appsec 3.682 ms [3.464 ms, 3.9 ms] 2.195 ms (147.7%)
iast 2.209 ms [2.146 ms, 2.272 ms] 722.443 µs (48.6%)
iast_GLOBAL 2.257 ms [2.194 ms, 2.321 ms] 770.816 µs (51.8%)
profiling 2.072 ms [2.02 ms, 2.124 ms] 585.366 µs (39.4%)
tracing 2.04 ms [1.99 ms, 2.089 ms] 553.058 µs (37.2%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 1.482 ms [1.471 ms, 1.494 ms] -
appsec 3.629 ms [3.415 ms, 3.843 ms] 2.147 ms (144.8%)
iast 2.214 ms [2.152 ms, 2.277 ms] 732.156 µs (49.4%)
iast_GLOBAL 2.261 ms [2.198 ms, 2.325 ms] 779.185 µs (52.6%)
profiling 2.048 ms [1.998 ms, 2.099 ms] 565.88 µs (38.2%)
tracing 2.026 ms [1.977 ms, 2.074 ms] 543.411 µs (36.7%)
Execution time for biojava 
gantt
    title biojava - execution time [CI 0.99] : candidate=1.53.0-SNAPSHOT~2819125973, baseline=1.53.0-SNAPSHOT~9f546b948b
    dateFormat X
    axisFormat %s
section baseline
no_agent (15.496 s) : 15496000, 15496000
.   : milestone, 15496000,
appsec (14.852 s) : 14852000, 14852000
.   : milestone, 14852000,
iast (18.505 s) : 18505000, 18505000
.   : milestone, 18505000,
iast_GLOBAL (17.901 s) : 17901000, 17901000
.   : milestone, 17901000,
profiling (15.124 s) : 15124000, 15124000
.   : milestone, 15124000,
tracing (14.703 s) : 14703000, 14703000
.   : milestone, 14703000,
section candidate
no_agent (15.541 s) : 15541000, 15541000
.   : milestone, 15541000,
appsec (14.736 s) : 14736000, 14736000
.   : milestone, 14736000,
iast (18.294 s) : 18294000, 18294000
.   : milestone, 18294000,
iast_GLOBAL (17.873 s) : 17873000, 17873000
.   : milestone, 17873000,
profiling (15.318 s) : 15318000, 15318000
.   : milestone, 15318000,
tracing (14.957 s) : 14957000, 14957000
.   : milestone, 14957000,
Loading
  • baseline results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.496 s [15.496 s, 15.496 s] -
appsec 14.852 s [14.852 s, 14.852 s] -644.0 ms (-4.2%)
iast 18.505 s [18.505 s, 18.505 s] 3.009 s (19.4%)
iast_GLOBAL 17.901 s [17.901 s, 17.901 s] 2.405 s (15.5%)
profiling 15.124 s [15.124 s, 15.124 s] -372.0 ms (-2.4%)
tracing 14.703 s [14.703 s, 14.703 s] -793.0 ms (-5.1%)
  • candidate results
Variant Execution Time [CI 0.99] Δ no_agent
no_agent 15.541 s [15.541 s, 15.541 s] -
appsec 14.736 s [14.736 s, 14.736 s] -805.0 ms (-5.2%)
iast 18.294 s [18.294 s, 18.294 s] 2.753 s (17.7%)
iast_GLOBAL 17.873 s [17.873 s, 17.873 s] 2.332 s (15.0%)
profiling 15.318 s [15.318 s, 15.318 s] -223.0 ms (-1.4%)
tracing 14.957 s [14.957 s, 14.957 s] -584.0 ms (-3.8%)

@cecile75 cecile75 requested a review from PerfectSlayer August 18, 2025 15:04
@cecile75 cecile75 marked this pull request as ready for review August 19, 2025 11:45
@cecile75 cecile75 requested a review from a team as a code owner August 19, 2025 11:45
@cecile75 cecile75 requested review from dougqh and removed request for a team August 19, 2025 11:45
@github-actions GitHub Actions
Copy link
Contributor

github-actions bot commented Aug 19, 2025 •
edited
Loading

Hi! 👋 Thanks for your pull request! 🎉

To help us review it, please make sure to:

  • Add at least one type, and one component or instrumentation label to the pull request

If you need help, please check our contributing guidelines.

@cecile75 cecile75 added type: enhancement Enhancements and improvements type: documentation tag: no release notes Changes to exclude from release notes comp: tooling Build & Tooling and removed type: enhancement Enhancements and improvements labels Aug 19, 2025
@cecile75 cecile75 merged commit dec3ce1 into master Aug 19, 2025
503 of 507 checks passed
@cecile75 cecile75 deleted the cecile/githubactions branch August 19, 2025 11:56
@github-actions github-actions bot added this to the 1.53.0 milestone Aug 19, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers

@PerfectSlayer PerfectSlayer PerfectSlayer approved these changes

@dougqh dougqh Awaiting requested review from dougqh dougqh is a code owner automatically assigned from DataDog/apm-lang-platform-java

Assignees
No one assigned
Labels
comp: tooling Build & Tooling tag: no release notes Changes to exclude from release notes type: documentation
Projects
None yet
Milestone
1.53.0
Development

Successfully merging this pull request may close these issues.
2 participants
@cecile75 @PerfectSlayer